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METHOD AND DEVICE FOR AUTOMATICALLY CHANGING A DIGITAL 
CONTENT ON A MOBILE DEVICE ACCORDING TO SENSOR DATA 

CROSS-REFERENCE TO RELATED APPLICATION 

5 

This application is the U.S. National Stage of International Application Number 
PCT/IB2002/002724 filed July 11, 2002 and published in English on January 22, 
2004. 

10 BACKGROUND OF THE INVENTION 

1. Technical Field 

The present invention relates to the field of mobile electronic devices capable of 
15 editing digital contents. It also relates to a new user interface and to a new way for 
editing digital contents in mobile electronic devices. The present invention also 
relates to a new way for automatically generating digital contents. The present 
invention fiirther relates to mobile devices with a huge storage. 

20 2. Discussion of Related Art 

The invention relates to the editing of digital text / audio/video content, which has 
been stored or taken via audio recorder, camera or received via DVB-T for instance. 
As a part of a new entertainment experience, users of mobile electronic devices can 

25 download personalization elements such as logos and ringing tones or sleep mode 
indications fi-om a supplier, as known fi-om mobile phones. The users of mobile 
devices are going to demand devices that enable the user to express creativity and 
personalization even via the electronic devices he uses. Users are going to demand 
the ability to modify and create electronic content with their mobile electronic 

30 devices. 

So far, mobile devices are quite limited in storage and processing power, but in near 
fixture there will be mass memories available even for mobile devices at reasonable 
prices enabling new exciting applications for customers. The present invention 
35 relates to new applications and mobile devices. A creation of digital content and the 
editing thereof by users is currently limited to SMS. 
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From the state of the art it is known to integrate an answering machine fiinctionality 
with announcement texts into a mobile telephone. This is for example described in 
the document WO 01/78364. In this document it is disclosed that an answering 
5 machine can reproduce different answering announcements depending on the actual 
operation state of the device. 

DISCLOSURE OF INVENTION 

10 In contrast, it is desirable to offer a user mobile electronic device capable of 
providing more than a playback functionality for „canned" text, logos, music, 
pictures and videos. Instead it is possible that an integrated answering machine be 
adapted to edit, generate, process and change digital content of storage in accordance 
with variable conditions such as sensor data, manual input, device settings and 

1 5 operating parameters, respectively. 

It is desirable to provide an improved ability of mobile devices and methods for 
creating and modifying digital content beyond the very limited state of the art. 

20 According to a first aspect of the present invention a mobile electronic device is 
provided that comprises a storage to store digital content and has a processor that is 
configured to edit said stored digital content, and that is characterized by a 
component to obtain data from an outside or inside sensor. The processor of said 
devices is configured to edit, generate, process and/or simply change said digital 

25 content according to said obtained sensor data. This embodiment is a kind of data 
analj^er of evaluatof, wherein said data are used to edit an electronic content. To 
visualize one of the benefits of this embodiment, the device can receive sensor data 
and automatically edit e.g. a digital form accordingly. Thereby, the digital content 
can e.g. be a digital form that is filled in according to said obtained sensor data. The 

30 special application and embodiment can be chosen according to the desired 
application and the desired functionality. 

To enable a new experience of entertainment, it is important to give users more 
freedom and possibilities to be creative and innovative. It is also important to make 
35 mobile devices reliable, so that they can be used for a couple of activities for which 
users up to now need a lot of devices. There is no reason why a user should be 
bothered with the maintenance of different battery packs of different mobile 



2 




electronic devices. As mentioned already, users do not want to just handle pre- 
designed content, they want to create own content and have freedom of editing it. A 
user might want to edit and combine, e.g. video sequences or still pictures with 
audio and text sequences. 

5 

As mentioned already, users do want to not only just consume content, they want to 
create own content and have freedom of editing it. E.g. video sequences or still 
pictures can be combined with audio (I.e. video clips played to music) and games 
and events or sensor data (incoming call, time, diary input, etc.). They can be 
10 recorded provided there is a kind of audio/video phone application in the device. 

Just as a non limiting example the generation of a digital document is executed by 
retrieving a template (like known from text programs like e.g. Microsoft Word). 
Then sensor data e.g. from a position sensor of the device are obtained by means of 

15 well known positioning systems. The template can then be recalled according to the 
present position, e.g. when recalling a template from the home position, a private 
template is automatically recalled and filled in with a home address: If the user is 
located at his workplace, a firm template can be recalled, and filled in with the firm 
address. In case the user is recalling the template from a location the device can 

20 identify, the position e.g. by comparative information evaluation, the template can be 
selected according to the person said address is related to. If a firm address is 
detected the firm template is recalled and added with a position information such as 
currently at "Firm ###". If the actual position is related to a personal fiiend, a private 
template can be recalled and the actual position e.g. with a commimication 

25 information can be added to the template. 

The same principle can be applied to the generation of the letter-heading of a FAX, 
e.g. on mobile fax enabled devices. 

Just as a non limiting example: in case of a game of skill application on said mobile 
electronic device, a gravity sensor can be used to maneuver a virtual bullet through a 
30 virtual maze by just tilting the mobile electronic device. In such an application, the 
electronic content would be game data or display data. 

In yet another embodiment said mobile electronic device fiirther comprises a 
communication device. The application of a communication device has the main 
35 advantage that a user can exchange e.g. a digital content, and can further receive e.g. 
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sensor data from a remote sensor according to a presently used application. 

In another embodiment of the present invention, said mobile electronic device 
further comprises a mailbox, wherein said digital content to be edited is an 
5 announcement of said mailbox. The mailbox can be a mailbox for electronic mail, as 
known from the field of mobile communication such as E-mail, SM (Short 
message), MMS (multi media message) and the like. The mailbox can be a voice - 
mailbox known from the mobile communication network. The mailbox or voice 
mailbox can be a built-in voice - mailbox also known as an answering machine. In 
10 the case of a built-in mailbox said digital content is e.g. an announcement text which 
is altered according to obtained sensor data. 

It should be noted that this embodiment of the invention is directed to obtain sensor 
data and generate a mailbox announcement according to said sensor data. The 
IS implementation of an answering machine in a mobile electronic device has several 
advantages: 

Different answer texts can be generated by editing a basic text 

20 - The calling line can be identified and the answering text can be edited 
accordingly 

Sensed phone profile settings can be used for editing an answering text 

25 - The location/context of the caller can be sensed and considered for editing the 
answer text. 

The answer texts and the relation to sensor data can easily be changed without 
call connection costs 

30 - 

Messages from callers are stored on the terminal and can be accessed easily, 
similarly without connection costs. 

The announcement of a mailbox can be automatically generated / edited in 
35 dependence of the present position and or the time. For example if no sensor data are 
available, a basic text like „This is telephone NR. ### please leave a message after 
the Signal" can be reproduced. If more sophisticated sensor data are available, and it 
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is detected that the caller is e.g. an employee of the same Fimi, an announcement 
such as: "Sorry Mr., ### I'm actually in a meeting in room NR. ###, plesise call back 
at ## o' clock, or dial 22 for a return call request, or leave a message after the 
signal". If more sensor data are available, an announcement like „This is //////// , I am 
5 presently on vacation on caiman island, local time 3 a.m. and I am surly asleep, 
please try again in 7 to 8 hours, or leave a message after the signal...". 

It may be noted that the answering text can be generated automatically or manually. 
In a basic embodiment e.g. only an announcement of a local time in an answering 
10 text can be edited automatically wherein e.g. the selection between a private or 
business answering text has to be made manually. 

Also, the present invention is not just directed to automatically selecting between a 
number of pre-stored answering announcements, it can also be applied to such a 
IS solution if e.g. two or more basic announcements are stored that are selected and 
edited according to said obtained sensor data. 

In another embodiment of the present invention said processor is configured to edit, 
generate, process and/or change the announcement of said mailbox automatically 
20 according to said obtained sensor data. A fiiUy automated selection and editing of 
announcements, requires less user interaction for a sophisticated answering machine 
fimctionality. 

This embodiment of the invention is for the situation that the user of a'mobile phone 
25 (or mobile device in general) gets an incoming phone call but is not able to accept 
the call. In these situations a phone answering machine is useftal to record a message 
fi-om the calling party. In mobile telephony, this fimctionality so far has been 
provided by the network operator, i.e. the message is stored in the network and the 
user can later establish a voice call to his personal mailbox in the network to listen to 
30 the recorded messages. 

If the mobile device is equipped with sufficient storage capacity, there are good 
reasons to integrate the answering machine fimctionality into the mobile device 
itself. On the one hand this reduces costs for the user because there is no need to call 
35 a personal mailbox in the network, and on the other hand the user benefits from the 
faster access to his stored messages. 
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The answering machine of this embodiment is much more refined than the 
conventional network-based solutions available today, and provides more 
convenience/comfort and opportunities to the user. For instance, the following 
functionality could be realized: 

5 

The answering machine can be configured in a way that it is 
activated/deactivated for specified callers or caller groups, if the device 
comprises a caller identification sensor, 

10 - The answering machine can be configured in a way that for specified callers / 
caller groups individual announcements are used, i.e. for business partners, 
fiiends and schoolmates, 

- Each caller / call group can be given a varying amount of time for leaving 
15 messages, by editing the maximum size of a storage area in a storage of SEiid 

phone. 

The answering machine can be configured in a way that the annoimcement varies 
according to time, niraiber of tried calls, location of the user, or other parameters, 
20 obtained via respective sensors. 

In addition to the voice/audio announcement the answering machine sends a 
predefined text or a multimedia message to the calling party, this message may 
be user configured to be sent only when e.g. a certain caller is connecting the 
25 mailbox, e.g. combined with a predetermined time period, 

- The answering fimctionality is not limited to incoming voice calls in cans of a 
voice box, but could be extended to handle incoming messages as well. This 
feature enables a user to reject E- mails fi"om certain addresses providing a 

30 "blacklist" fimctionality, to the mailbox. 

The answering machine can communicate with the network in order to divert 
selected callers / caller groups to another phone number, providing a selective 
rerouting, which may be combined with a net-based mailbox with an extremely 
35 long answering text, to overload undesired caller with unnecessary information. 

The answering machine can be operated depending on the currently active phone 
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mode or phone profile, the answering text can comprise information about the 
actually active phone mode. 

For the above scenarios it is helpful that the answering machine is very closely 
5 linked with the phonebook of the user and the currently selected phone setting in 
general, hi order to achieve the same level of functionality with network-based 
answering machine solutions, all information phone book entries, position data, local 
sensor data, etc have to be requested fi-om the phone. Another advantage of a built in 
mailbox resides in the fact that the incoming calls are stored locally in the device and 

10 not in the network, and the user can access the recorded messages faster than today 
and without the additional costs for calling his mailbox number. However, outside 
mailbox connection increases service provider profit. The user is also becoming 
more independent fi-om the environment since he has not to care about network 
coverage, etc. This embodiment of the invention provides a cheap and highly 

15 configurable call answering solution to users of mobile devices. The user fiirther 
benefits as he is becoming more independent fi-om network coverage, and as he has 
more options to adapt the system to his personal needs. 

In another embodiment, said mobile electronic device further comprises a mobile 
20 telephone. The mobile telephone application is mentioned to underline that the 
communication device can comprise a classical mobile telephone, and is not limited 
to just VoEP (Voice over Internet Protocol) or such devices. The use of the present 
invention in a mobile telephone or a communicator provides the advantage that 
many people can benefit fi-om the advantages rising from the automated editing of 
25 digital content, and automated answering machine text editing. 

In yet another embodiment of the present invention said mobile electronic device 
further comprises a text to speech transducer. The use of a text to speech transducer 
enables the device to reduce the amount of data to be stored necessary to generate 

30 and edit an answering text of said voice mailbox. So instead of storing a whole audio 
recording of the user's voice, the answering text can be stored as e.g. a small ASCII 
file. So according to this embodiment, the answering text can be stored and edited as 
a text and then, the edited text is "read out" by the mailbox e.g. by means of a 
synthetically generated voice. To personalize the synthetic voice the frequency 

35 range, the modulation and e.g. the speech rhythm of the user may be recorded and 
used for the generation of a digital content. 
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In one embodiment of the present invention, said stored digital content comprises 
digital audio data. With mass memory in place, it is possible to store large amount of 
audio data, hi a mobile electronic device providing this option, a software audio 
player application can be stored in a memory as well , so it does not have to be 
5 available as a hardware component in the device but it can be there, of course, as 
well. With an audio player and e.g. an audio recorder a user can use the mobile 
electronic device as an electronic dictating machine, offering a post process and 
editing function, to post-process digitally stored audio data, another application of an 
audio processing can be used to accompany an audio text with music. Especially for 
10 yovmg people a mobile device can comprise e.g. a MPS player offering a mixing 
desk ftmctionality to post process stored music according to the personal 
preferences. 

The audio embodiment of the present invention can also be used for audio 
15 composing. Audio composing and editing is comprised of: 

playing of audio content via intemal and/or external speakers/headphones 

creating of audio data from scratch via speech/sound recording, MIDI composer, 
20 ringing tone composer, soimd effects creation 

deleting, moving, copying, storing of content 

exchanging with other people , 

25 

mixing/combining (MIDI, speech samples, music), 
link to events 
30 - modifying/changing existing content 
converting format 

linking to events (like incoming MMS or calls) 

35 

attaching (e.g. to MMS) 
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In another embodiment of the present invention said stored digital content comprises 
digital picture/video data. With mass memory in place, it is possible to store large 
amount of picture and video data or even movies including soxmd, i.e. on a storage 
media such as an optical disc, a hard disc or the like. A software based player for 
5 audio/video content can be stored in this memory device, so it does not have to be 
available as a hardware component in the device, which can be there, of course, as 
well. A processing of video sequences is a vital prerequisite to the use of video data 
in a mobile environment. The use of uncut video data requires much storage space, 
which is too valuable to be wasted to visual ballast. With a possibility to edit e.g. the 
10 audio track of video data on a mobile device, a user may take one video sequence, 
and comment it with different audio tracks and transfer it to different addresses as a 
multimedia postcard, without the need to record a new video sequence. 

The device can be used as mobile audio/video player (i.e. compression means for 
15 storing a DVD on just a single CD-ROM do exist) and connected with home 
stereo/video equipment via a short range radio connection like Bluetooth or cable. 

The applications of the embodiments of the preceding description can be logically 
divided into e.g. three main parts: for example audio composing and editing, video 
20 composing and editing, and audio/video linking, audio composing has already been 
described in the preceding description. 

Video composing and editing is comprised of: 

25 - recording of video data from TV and integrated or attached camera (video 
sequences and still images) 

displaying still images and showing video sequences on device screen and 
connected TV or PC monitor, where resolution is adapted to resolution of 
30 connected screen 

creating images/videos from scratch using camera/drawing application 

copying, exchanging, backup, moving, deleting, 

35 

converting format. 
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- modifying/changing, mixing/combining, 

linking to events (like incoming MMS or calls), 
5 - attaching (e.g. to MMS) 

Audio and video linking is comprised of 

attaching of audio (e.g. sound, speech, music) to images and videos 

10 

attaching of images and videos to audio (e.g. soimd, speech, music) 

In yet another embodiment of the present invention, said stored digital content 
comprises digital text data. Compared to the processing of audio and video data, the 

IS editing of a text data seems to be known from editing SMs (Short Messages), but in 
the combination with the editing of pictures, audio and video data and the use of 
sensors for editing, even a text editing application is new and inventive. So one 
embodiment of a mobile electronic device according to the invention can be used to 
combine a picture with a headline, or a saying, provide subtitles to audio and video 

20 data and the like, which is actually not possible with currently available mobile 
devices. 

A picture gallery including images, photographs, smileys and audio samples can 
serve as starting point for creativity. The user can add own content, be it still images, 
25 small video sequences or own audio recordings. Equipped with a camera the device 
is a travel camera as well. A picture editor (i.e. stored on the removable medium) is 
to modify pictures and videos and it is possible to send them to friends via MMS. 
Similar is true for an audio editor. Digital postcards gallery at holiday saved on an 
optical disc is another embodiment. 

30 

As in the case of audio and video composing, editing, and linking, these techniques 
can also be applied and combined with digital text data. 

In fact, from possible actions point of view there is no substantial difference between 
35 audio and video content and the difference to a text content is dependent from the 
file format actually chosen, so it may be noted that a common composing and editing 
application for all digital content can also be used. 
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In yet another embodiment of the present invention mobile electronic devices further 
comprise a processor configured to evaluate said obtained sensor data. This 
evaluation step can help and will help to decide if an obtained sensor data is 
5 available and meaningful. E.g. in case of clock values below 0 and above 24 hours 
and temperature values below OK and above 400K the ranges are exceeded and are 
not meaningful and can therefore be rejected. Similarly, acceleration values above 
1 Og and speeds above 200 km per hour are also not meaningful and therefore should 
be rejected, as it can be expected that the phone under such conditions can not be 
1 0 operated properly. 

Another benefit of an evaluation of the sensor data provided is that the editing of the 
digital content is executed according to proper data and according to a proper 
relationship between sensor data and digital content to be edited. This may best be 

15 visualized by an example of the aforementioned mailbox embodiment. In the 
mailbox, a basic answering text can be chosen and altered according to the sensor 
data, in case of the inconsistent sensor data, these data can be rejected to prevent an 
inconsistent answering text. Thereby answering texts such as "I am, on vacation on 
room ###, will not be back until march 17, please leave massage after the signal" 

20 wherein a device status (vacation, and retum on march 17) information is in conflict 
with a position information (room ###). Such conflicts can be detected and avoided 
by an evaluation operation such as plausibility estimation. Such plausibility 
estimations can e.g. be done by means of a plausibility table or a list of incompatible 
events. 

25 

In ainother embodiment of the present invention said component to obtain sensor 
data comprises a receiver. A receiver can be used to receive e.g. a clock signal such 
as the DCF 77, or remote data from GPS satellites or from a remote sensor e.g. 
position sensor data via cellular positioning methods such as Enhanced Observed 
30 Time Difference (E-OTD). In case the environment provides a low range radio 
network such as a Bluetooth or WLAN network a receivers network identification 
can be used to identify a location of the mobile electronic device. 

According to yet another embodiment of the present invention said component to 
35 obtain sensor data comprises at least one built-in sensor within said mobile 
electronic device. Such sensors can be battery power devices, sensors to detect if 
said device is operated in a car with a hands-free device, illumination sensor. 
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temperature sensors, sensors for determining a remaining storage space and the like. 

In another embodiment of the present invention, one of said sensors is an 
acceleration sensor. In case of an acceleration sensor said audio editing application 
5 can use the sensor data to generate e.g. a beat or drum rhythm if the user moves the 
device in a drumstick fashion, wherein the amplitude and the shape of the movement 
can be used to generate sound and loudness and the frequency to generate a beat. 
This would be some kind of a handheld percussion device. In the same fashion 
virtual Drums, Bongos or even virtual Xylophones are realizable, e.g. by integrating 
10 the data of the acceleration sensors and relate every position to another tone. 

Another editing application in the field of text editing can e.g. be a format and a 
"sponge"-functionality. For example an acceleration sensor can be used to detect if 
the device is tilted, and can accordingly adapt the setting of a text, e.g. if the device 

15 is tilted to the left or right, a text on the device is formatted to the left or the right, 
respectively. If the device is tilt up, a new line is created, and if the device is tilt 
down a new paragraph is created. The sponge fimctionality, can be embodied e.g. as 
follows: if the device is shaken once, the last word can be removed, and if the device 
is shaken twice the last line or sentence is removed, if shaken three times the last 

20 paragraph can be deleted and if the device is shaken continuously the whole 
document is deleted. In another embodiment, the shaking process can be used to start 
a coding or an encryption of said text document. 

A more general method for performing the editing of content with an acceleration 
25 sensor can be provided by modifying pictures/images, according to a detected 
movement. The faster the device is moved into a certain direction the more the 
image changes accordingly. In case of a gravity sensor application, a virtual bullet 
can be rolled over a concave RGB plane, so that a user can change histogram data by 
tilting the device. In case a color monitor is used, the three color edges can be 
30 depicted by color patches in the comers of the display, and a small e.g. bullet shaped 
cursor indicates the position of a histogram element in an RGB plane. 

In another embodiment of the present invention one of said sensors is a position 
sensor. Positioning sensors such as GPS (Global Positioning System) / DGPS 
35 (Differential GPS), Glonas (Global Navigation System), or cellular positioning 
methods such as E-OTD provide an auto editing feature for letter-heading, or an auto 
position indication for mailbox announcements, the letter-heading feature can be 
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used to automatically insert address or sender information according to the present 
position in a letter or an E-mail, or the like message. 

In another embodiment, said mobile terminal device comprises an optical sensor. 
5 The optical sensor can be in the simplest case an illumination sensor for changing 
e.g. an display illumination, more sophisticated embodiments can provide a 
biometrically based user recognition system to recall user specific settings according 
to a determined user. The optical sensor can be a fully grown scanner capable of 
reading texts without the need to touch a surface e.g. by a photo or a scanning beam 
10 based system. 

In another embodiment of the present invention said sensor is for sensing 
atmospheric properties. The sensor can be to measure temperature of the device or 
the body temperature of the carrier of said mobile terminal device, and other 
15 meteorological values such as, pressure on the device, air pressure, humidity, 
insolation (solar flux), pollution values, e.g. poll incidences for allergic persons, 
Ozone values and the like. 

Pressure sensor values can be used to enhance a text in the text mode to generate a 
text bolder or thinner flag according to a sensed pressure. The pressure sensor can be 

20 used to mark text passages or to play, play fast forward or rewind digital music data 
and the like, to provide a kind of , jog dial" functionality to a simple pressure sensor. 
Another example is a temperature sensor. Depending on the ambient temperature an 
image could change its saturation or a speech sample its pitch frequency. Also the 
noise level picked up from the microphone or the dynamics of music currently 

25 played can be used as input for editing. Using sensor input, funny and not easy-to- 
predict rnodification of content is possible. 

The atmospheric properties comprise also periodical pressure fluctuations, 
commonly denoted as sound noise or the like. It is to be noted, that a microphone 

30 falls under the wording of the respective claim. One application to edit a digital 
content with the use of sound can be given e.g. by changing graphical content like a 
picture with a sound input. A game application can be used to control the movement 
of an object by a sound, in the case of the mobile phone game "snake" this can be 
used to direct the snake to the left and to the right by humming high and low 

35 frequencies. Such a game application can provide an additional experience to the 
user, if the snake can move freely even diagonal on the display. Another example of 
a sound sensor controlled editing can be a drawing application using the loudness 
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and a detected tone to move a cursor over the display to sketch small drawings. 

In yet another embodiment of the present invention said mobile electronic device 
further comprises a processor being configured to change device settings according 
5 to said obtained sensor data. This processor provides extra features for an increased 
user friendliness, as the sensor data are available they can be used to simply the user 
interaction e.g. by adapting the brightness of a display device to the data received 
from an illumination sensor. Another application would be to scroll or mark a text 
document according to received orientation sensor data. Acceleration data can be 
10 used to change the pitch, speed, and the volume of a sovmd or a piece of music. Such 
features are known from e.g. spaceship toys to generate space and action sounds to a 
simple piece of plastic, but such a toy can only generate a sound and is not capable 
of editing a sound or an audio file. 

15 Another embodiment of the mobile electronic device further comprises a user 
interface, for manually overriding said automated editing functionality. Thereby a 
user can generate a text without the use of the automated devices of the preceding 
description. So a user can edit a digital text, audio or video content according to his 
preferences and can generate a mailbox answering text according to his preferences 

20 without being forced to use the sensor input. 

According to another aspect of the present invention, a method for editing digital 
content on a mobile electronic device in accordance with obtained sensor data is 
provided. The method comprises obtaining of sensor data from a sensor, and editing 

25 a digital content in accordance with said obtained sensor data, said sensor data can 
concem e.g. information related to the context of said mobile electronic device. As" 
can be recognized from the preceding description of the mobile terminal devices said 
digital content can comprise text, audio and video data and the sensor input can be 
received from an extemal sensor or from an intemal sensor of said mobile terminal 

30 device. 

In one embodiment of the method said edited digital content is an announcement . 
message stored in said mailbox. The main benefit of a mailbox editing an answering 
text according to received sensor data is that only a relative small number of 
35 relations is required to provide a sophisticated and huge ntunber of different, 
accurate and informative £inswering texts to a single answering machine. 
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Another embodiment of the present method further comprises the reception of a 
communication request. The reception of a communication request can be used to 
initiate the editing of a basic answering text according to the present invention. If the 
answering text should comprise a personal word of welcome, it is helpful to know 
5 the sender of the communication request. Additionally, if the reception of a 
communication is used to start the editing of a communication request, the number 
of editing operations can be reduced to a minimum. 

Jn another embodiment of the method said obtained sensor data are evaluated, and 
10 said editing of said digital content is executed in accordance with the result of said 
evaluation operation. 

Another embodiment of the present invention further comprises the reception of 
sensor data from an extemal sensor. The external sensor can be a position sensor, a 
1 5 sensor to identify a sender of a communication request and the like. 

According to yet another embodiment of the present invention, the method further 
comprises transmitting of said edited digital content. Li the mailbox appUcation this 
represents the replay of the answering text to a caller. Li contrast to the standard 
20 answering machine the answering text can be generated just in the moment it is 
required. The generation of said answering text can be executed by editing a basic 
text according to said obtained and evaluated sensor data. 

Li another embodiment of the method, the settings of the device are changed 
25 comprising changing of device settings in accordance with said sensor data. This 
change of settings provides an increased user friendliness, which could be used as 
the sensor data are available anyway. 

Yet another embodiment of the present invention provides a method further 
30 comprising manually editing said digital content by user input. Such a "manual 
override" can be used to provide a semiautomatic editing functionality. A manual 
override further helps a user to use the mobile electronic device as a conventional 
device. 

35 According to another aspect of the present invention, a software tool capable of 
carrying out the methods of the preceding description is provided, which comprises 
program code means for performing all of the steps of the preceding description 
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when said software tool is incorporated in a program which is run on a computer or a 
network device. 

According to yet another aspect of the invention, a computer program is provided 
5 comprising program code means stored for carrying out the aforementioned methods 
of the preceding description when said computer program is run on a computer or a 
network device. 

According to yet another aspect of the invention, a computer progrcun product is 
10 provided comprising program code means stored on a computer readable medium 
for carrying out the method of the preceding description when said program product 
is run on a computer or a network device. 

For the purpose of this specification the term "edit" is used to encompass all kind of 
15 generating new content, processing available content, selecting and producing 
alternative content and changing content. 

BRIEF DESCRIPTION OF THE DRAWING 

20 In the following, the invention will be described in detail by referring to the enclosed 
drawings, in which: 

Figure 1 is block diagram of a method operating a mobile mailbox for adapting an 
announcement to sensor values according to one aspect of the present invention, 

25 

Figure 2 is a block diagram of depicting the adaptation of an answering text of a 
mailbox according to figure 1, and 

Figure 3 is an example of an embodiment of the mobile device according to another 
30 embodiment of the present invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Figure 1 is a block diagram depicting the operation of a mobile communication 
35 device with a built in mailbox capable of adapting an answering text to obtained 
sensor values. The process is initiated with the reception of a communication 
request 100 at the mobile conununication device. As in the case of conventional 
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communication devices with mailboxes, it is determined if the mailbox is activated 
102. This is usually done by requesting the settings of the communication device. If 
the device is e.g. in a sleep mode, and it is not to be expected that the user will take 
the call, the mailbox is activated 110. If the mailbox is not activated, a ring tone is 
5 started 104, as in the case of a conventional mailbox. Simultaneously a timer is 
activated to detect if the user is accepting the call or not. If the user accepts the call, 
or the timer is active if the mail box is not activated 106. If the timer runs out while 
the communication request is still active and the call has not been accepted by the 
user, the mailbox is activated 108. 

10 

The activated mailbox starts reading out sensor values 110. Next, the sensor values 
are evaluated 1 12 to obtain information how the answering text is to be selected or 
adapted to the sensor values. The evaluation comprises steps like discriminating 
sensor values, judging the values and sorting the values according to their 

15 importance. This can be done by tables, functions and relations, or other user 
selectable regulations. So, e.g. a position information can be rated higher than a local 
time of day, and temperature data may be rated the lowest. The evaluation can be 
executed by defining e.g. an operationaWenvironmental- state tuple, and the 
evaluation can be done by using vector algebra, or a matrix calculation, to obtain an 

20 answering text tuple which can be used to generate/adapt an answering text to the 
present situation. The mailbox can then select a basic answering text 114 and adapt 
116 it according to the answering text tuple. The generated answering text or 
announcement is then reproduced to the caller 118. According to the answering text 
a recording can be started 120 to enable the caller to leave a message. The mailbox 

25 can terminate the connection 122 after the recording, or directly after the 
armouncement, depending on the values in the answering tuple of to the chosen 
answering text. 

Figure 2 is showing one embodiment of the editing of an answering text of a 
30 mailbox according to another aspect of the invention by means of a block diagram. 
As an example the editing of an announcement of an answering machine is used. 
The depicted functionality corresponds to the blocks 110 to 118 of figure 1 and 
shows another method of generating and adapting the armouncement of a voice 
mailbox. The method starts with the detection of a triggering event 2. In a mailbox 
35 system this is the reception of an incoming communication request, for example a 
call. It is assumed that the device executing this method actually has recognized in 
step 2 that an announcement is to be produced, e.g. by having requested the 
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operational state of the device. In step 2 the answering machine recalls a basic 
answering text 4, and after that, requests a first sensor 6 to produce a sensor value 
and requests the processor to edit the basic text to the details of a private mode. An 
example of a basic answering text can be "This is number 26580, please leave a 
5 message after the signal" The first sensor 6 can e.g. be a Bluetooth component to 
determine the presence of a local wireless network which indicates an office or a 
home environment. This first editing can be used to add a private greeting 8 or an 
official greeting 10 to the basic annoimcement text 4. The private greeting 8 can 
change the heading to: "This is Suzy and Paul...", and an official greeting 10 can e.g. 

10 sound like: "Welcome to NOKIA, Dr. Frank is actually not available... wherein 
this change can be done according to automated processing capability of the 
processor. After fixing the intro, a sensor 16 can be used to determine additional 
information such as: "... we are actually in the cinema/opera, ..." 18 or " we are 
shopping..." 20, according to the sensor information of sensor 16. The sensor 16 is 

15 an activity sensor capable of determining a user activity. The sensor information 16 
can be entered manually by the user, or may be derived fi-om a diary and a time / date 
information. In case of the formal annoimcement, the sensor information can recall a 
text element as ".. I'm in a meeting .." 12 , or "... I'm actually away on business ... 
"14. The next sensor 26 can be used to determine information related to an expected 

20 accessibility of the user, like "... until 23 o' clock ..." 28 or "... till October the 3'"^ " 
22. An additional sensor 36 can be requested for information about the presently 
available storage space to generate or insert an end text like ", ...please leave a 
message after the signal, and we call you back.... BEEP ." 38 or an ending like 
"please try again." 32. In the present example the basic text " This is number 26580, 

25 please leave a message after the signal ", has been altered into " This is Suzy and 
Paul..:we are actually in the cinema.. . imtil 23 o'clock ...please leave a message after 
the signal, and we call you back. BEEP ", as created by blocks 8, 4, 18, 28, 38. 
Then finally the whole text is reproduced and sent to the origin of the 
communication request 50. 

30 

Figure 3 is an example of an embodiment of the mobile device shown in an 
environment necessary to operate a sensor controlled answering text generation, 
according to another embodiment of the present invention. Figure 3 can be divided 
up into three parts. 

35 

Part one is a communication network 70 providing a mobile connectivity to the 
mobile terminal device 60 via a mobile base station 72 and an air interface 74. The 
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mobile commimication network can e.g. be a GSM or a UMTS network as known in 
the art. The base station can be a conventional base station as known in the art. The 
air interface 74 connecting the network 70 and the terminal device 60 can be 
embodied as a conventional TDMA (Time Division Multiplex Access) connection 
5 or any other radio connection. The elements 70, 72 and 74 are only to provide a path 
to deliver a communication attempt to the mobile terminal device 60. 

Part two is the mobile terminal device 60. The mobile terminal 60 comprises an 
antenna 86 to connect to the base station 72 and to extemal sensors 66 via respective 
air interfaces 74, 68. The mobile terminal device- comprises in this case an intemal 
temperature sensor 64 and an intemal time sensor 62, indicated as the depiction of a 
thermometer and a clock on a display of the device 60. Both sensors are connected to 
the processor 80. The processor 80 is connected via a radio component (not shown) 
to the antenna to exchange data and information with the conrmiunication network 70 
and with extemal sensors 66. 

The processor 80 is further connected to a mailbox memory 81 storing basic 
announcements and text elements to adapt the annoimcements to sensor data 
received from intemal 62, 64 or extemal 66 sensors. The processor 80 is further 
20 connected to a relation memory 82 storing basic relations or prescriptions on how to 
process and interpret the sensor values and how to generate and adapt the 
announcements and text elements to generate a respective answering text. 

Part three is at least one extemal sensor 66 connected to the device via an air 
25 interface 68. These sensors can be, e.g. satellites of the GPS system, Bluetooth 
devices or the like to determine a position or the like. 

As described in the figures 1 and 2, the mobile terminal comprises all elements 
necessary to adapt an announcement of a mailbox to sensor data received from 
30 intemal or extemal sensors. 

It may be noted, that in the case that no sensor data are available, the basic 
answering text is reproduced unchanged. 

35 It may be noted that the devices in the present description need a relatively large 
storage space such as a micro hard-disc, to offer a good functionality of automated 
editing functions. The mobile electronic devices have a large memory for storing 
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digital audio and video content and computing capacity for creating and editing such 
kind of information. In case of a small data base to be edited it may otherwise be 
better to just have a collection of pre-stored solutions to be recalled as in the case of 
a conventional answering machine changing the text in dependence of the remaining 
5 storage space. 

It is to be noted that the invention is about editing digital text/audio/video content, 
which has been taken via audio recorder, camera or received via DVB-T for 
instance. In fact, the invention is valid for all type of audio/video content being on 
10 said mobile device or brought to the mobile device, independently of the 
transmission path (i.e. by memory card, over the air, by Bluetooth link, SMS, MMS, 
etc.). 

This application contains the description of implementations and embodiments of 
15 the present invention with the help of examples. It will be appreciated by a person 
skilled in the art that the present invention is not restricted to details of the 
embodiments presented above, and that the invention can also be implemented in 
another form without deviating from the characteristics of the invention. The 
embodiments presented above should be considered illustrative, but not restricting. 
20 Thus the possibilities of implementing and using the invention are only restricted by 
the enclosed claims. Consequently various options of implementing the invention as 
determined by the claims, including equivalent implementations, also belong to the 
scope of the invention. 
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Claims 

1. Mobile electronic device, comprising a storage to store digital content and 
5 processor being configured to edit and change said stored digital content, 

characterized by a component to obtain data provided from a sensor, wherein 
said processor is configured to generate and/or process said digital content 
according to said obtained sensor data. 

10 2. Mobile electronic device according to claim 1, further comprising a 
communication device. 

3. Mobile electronic device according to claim 2, characterized by a mailbox, 
wherein said digital content to be edited comprises an annoimcement message 

1 5 contained in said mailbox. 

4. Mobile electronic device according to claim 3, wherein said processor is 
configured to generate and/or process a basic announcement of said mailbox 
automatically according to said obtained sensor data. 

20 

5. Mobile electronic device according to claim 3, further comprising a text to 
speech transducer, to read out said announcement stored as a text data file. 

6. Mobile electronic device according to claim 4, wherein said commxmication 
25 device is a mobile telephone. 

7. Mobile electronic device according to claim 1, wherein said stored digital 
content comprises digital audio data. 

30 8. Mobile electronic device according to claim 1, wherein said stored digital 
content comprises digital picture/video data. 

9. Mobile electronic device according to claim 1, wherein said stored digital 
content comprises digital text data. 

35 

10. Mobile electronic device according to claim 1, further comprising a processor 
configured to evaluate said obtained sensor data. 



21 



1 1 , Mobile electronic device according to claim 2, wherein said component to obtain 
sensor data comprises a receiver. 

5 12. Mobile electronic device according to claim 2, wherein said component to obtain 
sensor data comprises at least one sensor built-in in said mobile electronic 
device. 

13. Mobile electronic device according to claim 1, wherein said sensor is an 
10 acceleration sensor. 

14. Mobile electronic device according to claim 1, wherein said sensor is a position 
sensor. 

15 15. Mobile electronic device according to claim 1, wherein said sensor is an optical 
sensor. 

16. Mobile electronic device according to claim 1, wherein said sensor senses 
atmospheric conditions. 

20 

17. Mobile electronic device according to claim 1 further comprising a processor 
being configured to change device settings according to said obtained sensor 
data. 

25 18. Mobile electronic device according to claim 1 further comprising a user 
interface, for providing a user interface for manually overriding said 
generating/processing. 

19. Method, comprising 

30 obtaining data fi-om a sensor, and 

generating/processing digital content stored on a mobile electronic device in 
accordance with said data obtained fi-om said sensor. 

20. Method according to claim 19, further comprising receiving a communication 
35 request. 



21. Method according to claim 19, wherein said generated digital content is stored as 
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an announcement file of a mailbox. 

22. Method according to claim 19, further comprising evaluating said data obtained 
from said sensor, and wherein said generating/processing of said digital content 

5 is done in accordance with a result of said evaluation operation. 

23. Method according to claim 19, further comprising receiving sensor data from an 
external sensor. 

10 24. Method according to claim 19, further comprising transmitting of said changed 
digital content. 

25. Method according to claim 19, further comprising changing of device settings in 
accordance with said sensor data. 

15 

26. Method according to claim 19, further comprising manually editing said digital 
content by user input. 

27. Software tool comprising program code means for carrying out the steps of claim 
20 19 when said program is run on a computer device or a mobile electronic device. 

28. Computer program comprising program code means for carrying out the method 
of claim 19 when said program is run on a mobile computer or network device. 

25 29. Computer program product comprising program code means stored on a 
computer readable medium for carrying out the method of claim 19 when said 
program is run on a network device or a mobile computer device. 
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Abstract of the disclosure 

Disclosed is a method for handling and generating and editing of digital documents 
5 or digital contents on mobile electronic devices in accordance with sensor data 
perceived. The method comprises the reception of sensor data or the monitoring of 
sensors, and the generation of said digital content according to said perceived sensor 
data. It is further disclosed a mobile terminal and a network device disclosed that are 
capable of handling a digital content according to the above mentioned methods. 

10 
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